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TODAY’S ROADMAP 






THE SOLUTION f 1 

HERMES IS BORN 

THE PR^^H 




I APPLYING TO 
THE GAME 





INITIAL ARCHITECTURE 


THE PROBLEM 


Game Clients 



Distributed Cache 


MySQL 





EXPLICIT COMMS 


THE PROBLEM 





THE MOVE TO MICRO SERVICES 


MICRO-SERVICES & STANDARDS 


Service communications became very important 

Client Service 

Built on Twitter’s Finagle initially 
Problems with interop, weight, and complexity 
Couldn’t agree on a common approach 
Limited the infrastructure we could build... 






SERVICE COMMUNICATIONS RFC 


MICRO-SERVICES & STANDARDS 


Evaluated options to find a winner 

Created dozens of criteria and weighted them 
Big concern was performance and latency 
Scored Mercury, Thrift, JSON-RPC, REST/HTTP, others 




AMBASSADOR FTW 


AMBASSADOR FTW 




AMBASSADOR 


MICRO-SERVICES & STANDARDS 


Spec first... then implementations 

HTTP + JSON + date formatting rules 
Covers REST and RPC 
Implement any way you want! 


Client in any language 


Service in any language 




AMBASSADOR FTW 


AMBASSADOR FTW 


Separate spec & 
implementations 


HTTP + JSON + interop rules 
Covers REST & RPC 
Implement any way you want! 


Client in any language Service in any language 




SWAGGER TO CREATE “LIVING APIS” 

AMBASSADOR FTW 




/purchase-vl -entitlements 


GET 


/{region}/v1/entitlements/{accountid} 


Show/Hide List Operations Expand Operations Raw 
Get Entitlements (secured with scopes: riot.store.purchase.view) (REST) 


Response Class 

List[EntitlementDTO] 

class EntitlementDTO(inventoryType: string = ['BOOST' or 'BUNDLES' or 'CHAMPION' or 'CHAMPION_SKIN' or 'RP' or 'RUNE' or 
'SPELL_BOOK_PAGE' or 'SUMMONER_CUSTOMIZATION' or 'SUMMONERJCON' or 'WARD_SKIN'], items: List[EntitlementltemDTO]) 

Parameters 

Parameter Value Description Data Type 


AUTHORIZATION 


region 

accountid 

product 

inventorytype 


MAIN1 


(required) 

LOL 

BOOST 


Auth header: (Mock: Mock 
mocktoken) (GasToken: string 

GasToken encodedgastoken) 

Player Region string 


Platform Account Id 
(authPrincipalType: Account) 

Product requesting 
entitlements 


long 

string 


Type of inventory to retrieve string 


Try it outl 







HERMES 


MICRO-SERVICES & STANDARDS 


Java implementation of Ambassador 

Server side -> Jersey + standard idioms 
Client side -> Auto-generated proxy 
Spiked out in a week to get buy-in 
22 Riot contributors 







AUTH VIA FILTERS 


INTEGRATORS & RCLUSTER 


Invoker 


On behalf 
of Principal 


Client 


Calls 
out to 
service 


Supplier 
(adds token) 


Service 


Provider 

(checks token) 


Service 

Logic 




START WITH THE CONTRACT 


HERMES IS BORN 


@HermesContract( 

approach=/?£Sr, name="group. contract" , version="1.0.0", 
description="Tutorial example", errors = {"5011 Problem logging"}) 

public interface TutorialContract { 

@P0ST 

@Path("vl/printMessage") 

@HermesOperation(summary="Print a message", version="l.l") 
void printMessage(@QueryParam("message") String message); 




SERVICE CODE 


HERMES IS BORN 


@Path("tutorial " ) 

@Consumes(MediaType . APPLICATIONS SON) 

@Produces(MediaType . APPLICATIONS SON) 

@Slf4j 

public class TutorialService implements TutorialContract { 

public void printMessage(String message) { 
Zog.infoC'Message: " + message); 

} 

} 





STARTING THE SERVER 


HERMES IS BORN 


HermesServer server = HermesNettyServerBuilder.newBuiZc/erO 
. singletons(new TutorialServiceO) 

.base( "tutorial") 

. requestFiltersC . . . ) 

. responseFilters(. . .) 

.integratorsC. . .) 

.buildQ; 






CLIENT CODE 


HERMES IS BORN 


HermesClient client = HermesClientBuilder .newBuilderQ 
. basellRIsC” http : //localhost : 7772" ) 
.proxyContractClass(TutorialContract. class) 
.proxyPathHint( ’tutorial") 

.filters(new LoggingFilterQ) 

. integratorsG..^.) 

.buildO; 

TutorialContract proxy = client .createProxyO; 
proxy. printMessageC'Hello world"); 





INTEGRATORS ALLOW ENCAPSULATION 


INTEGRATORS & RCLUSTER 


Integrator 

integrate(builder) adds filters to the builder, sets options 

HermesServerBuilder build() 

(options live here) 


HermesServer 




PLUG & PLAY INTEGRATORS 

INTEGRATORS & RCLUSTER 


Vapor 

BWB 



Auth 

Cache 


Atlas 




Auth 


BjSWliPL 


GAS 


mmm 


Auth 


Cache 


Basic 

Hermes 


Auth 




LDAP 

Auth 


Service 



Discovery 




Client 



RFC 

Server Metrics 



100 

Metrics 





CACHING INTEGRATORS 


INTEGRATORS & 





Client 


10M Requests per second 


c 

200k 


s 

20k 



(ETag) 


Service 






Polling simplifies failure scenarios 

Clients poll service 
Services don’t need eventing 
Services don’t remember connections! 




RCLUSTER 


INTEGRATORS & RCLUSTER 







METADATA SERVICE 


LoL Platform 


API 


Hermes 





LEAGUES 


APPLYING TO THE GAME 


LoL Platform 


API 


Netty 

Hermes 

Static 

IPs 



Leagues Box 


leagues.war 


Coherence Box 


Shard 1 


Shard 2 


Shard n 



STORE 


APPLYING TO THE GAME 


Purchase API 



Caching 

Catalog API 



A k 

Wmm 

Loot API 




MOBILE TEAM 


APPLYING TO THE GAME 


Heavily customized for their stack 



Validation 

Annotations 


Server 




FUTURE PROOFING 




FUTURE WORK 


Async events + HTTP2 

Eventing for async communications 
RxJava + reactive patterns 
Jersey 2.x, HnP2 

Open sourcing to build community of integrators 
https://github.com/riotgames 




QUESTIONS? 


ANDREW MCVEIGH 

Software Architect 
Riot Games 

amcveigh@riotgames.com 




